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ABSTRACT 

This repor^ describes the midterm and final tests administered to pupils 
In the Quality Assurance classes using the Learning Mastery System. 
Results are reported separately for both the Bank Street and Harper & Row 
versions of LMS«. Means, standard deviations, and frequepcy distributions 
are given for the subscores and total for eac^h test. The rBsuIts of the 
final -tests are also reported by number of units pupils completed. , 
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- LEARNING MASTERY SYSTEM MIDTERM AND FINAL TESTING 

/ 

Tntroducti^on ^ 

The SWRL Learning Mastery System (LMS) is a set of procedures and 
materials designed for \^^>y teachers in assessing pupil learning and 
providing extra practice when needed. During the 1970-71 schoor year, 

b r 

LMS procedures and materials developed by the Laboratory to acctjmpany 



reading 



both the Harper & Row and the MacMillan Bank Street first grade 
programs were made available to schools under a nonexclusive license 
agreement « 

m 

Some of the LMS program users were asked to provide enroute infor- 



mation to the Laboratory on several indicators of program performance as 
part of the Quality Assurance sample*^ Of the 361 schools participating 
in the Harper 6e Row version of LMS in 1970-71, 17 schools (5%) were 
selected for the Quality Assurance sample ♦ The LMS Bank Street Quality 
Assurance sample . included six schools or 6 present of the 94 schools using 
the program ♦ 

Included also as part of the Quality Assurance procedures were mid- 
term and final tests* These tests were .administered to pupils in the 
"Quality Assurance classes and were designed to measure pupil performance , 
midway and at the end ofr the school year* Tl\^ results of the testing 
are presented and discussed in this paper ^ 

Harper & Row Tests ; The 62- item Har.per & Row midterm covered pro- 
gram content through unit seven while the 69-itetn posttest included , 
questions on all 15 program units. Twelve* of the posttest items, however. 



'^For complete information on Quality Assurance, see TN 5-71-54, "The 
Development of the 1970-71 Quality Assurance Procedures," 



were given only to pupils who completed at least 12 .units. These tests 
measured pupil achievement on ejach of the seven Harper 6e Row outcomes: 
Words, Word Elements, Word. Attack, Comprehension, Study Skills, ^ 
Linguistic Skills, and Structural Analysis, 

Bank Street Tests; The 50-item Bank Street midterm test covered the 
first five units of the program while the 63-item posttest measured 
pupil performance on all 13 program units. These tests inclu^led questions 
on all seven outcomes of Bank Street: Words, Word Elements, Word Attack, 
Auditory Perception/Visual Discrimination, Structural Analysis, Compre- 
hension and * Interpretation, ind Habits and Study Skills* 

gample s 

For the midterms test^, all pupils in the Quality Assurance classes 
were tested; However, it was subsequently determined that considerable 
teacher time was required to administer the individual tests. For the 
postttest, therefore, teachers were asked to test 10 randomly selected 
pupils and any others^n the class as time permitted ♦ 

Harper & Row/sample : Of the 6S classes lisjted as participants in 
the Harper 6c Roy Quality Assurance sample, seven classes did not forward 
any data to SWRL during the year and one class sent notice of its non- 
participation. Of4:he remaining 57 classes, A8 returned midterm Cest 
forms providing information on 1096 pupils* For the Harper & Row post- 
test, 37 classes fojivarded test data t^the Labcwratory for 45p> pupils. 

* Bank Street Sample ; Thirty-eight classes were originally listed as 
participants in the Bank Street Quality Assurance sample. However, iiwe 



classes at one school were using the Harper & Row ^jersion of LMS and 
four more classes^ewr forwarded any data to SWRL* 6f the 26 remaining 
classes, eight sent test forms to the Laboratory for both the midterm 
and posttest. Midterm information was received for 133 pupils while 
posttest data for 78 pupils was received* 

Since the principal purpose of the Quality Assurance tryout was to 
determine a base rate for Quality Assurance procedures^rather than to^ 
evaluate LMS pupils, further efforts to follow up non-responding classes 
were not pursued. The non-responses render the data useful for intra- 
program comparisons but suspect for LMS summative evaluation purposes • * 

Procedures for Administration of Mldtenas 

The testing procedures for both the Harper & Row and Bank Street 
versions of LMS were identicals In January 1971, a packet containing 
the appropriate midterm test booklets, pupil answer sheets, directions, 
a cover letter, and a postage-paid, pre- addressed envelope was mailed to 
the teachers. The cover letter directed the teachers to administer the 
midterm tests individually to pupils between February 8th and 19th* The 
instructions emphacrized that, the teacher should present all items on the 
test to each pupil in the program* The teacher* had the option of testing 
all pupils on one day or to extend the testing over the time period,. 
The directions explained the procedures for presenting each item and 
recording each pupiJL's scores* Test sheets were returned to SWRL via 
the pre-addressed, postage-paid ^envelope e0iosed in the test packets 
Copies of the midterm test materials are included in Appendix A* 



Procedures for Administration of Pogttests 

The posttest procedures were also identical for both the Harper & 
Row and Bank Street versions of LMS. In May 1971, a^I^acket containing 
the appropriate posttest booklets, pupil answer sheets, a list of pupils 
to be tested, directions, a cover letter, and a postage paid, pre-addressed 
envelope was sent to the teachers. They were asked to individually 
administer the test anytime before June A,* 1971, to a sample of 10 or 
"more pupils in their class. The lists of pupils to be tested were pre- 
pared by Laboratory personnel by randomly sampling 10 pupils from the 
most recent class rosters. Alternates were also included "on the'^lists 
in case of pupil absences.' Matetials were provided, however, for testing 
the entire class if time permitted. Seven Harper & Row classes and one 

. A ^ 

Bank Street class did test more than the required 10 students. Copies 
of the posttest materials ^re included in Appendix |B. 

Results 

Harper &/ Row Midterm ; Table 1 presents the results of the Harper ' 
6e Row midterm giving the'means, standard- deviations, and frequency distri- 
butions in numbers and precents for each 'outcome on the test. The fre- 
quency distributions are also illustrated in Figure 1. 
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Harper -6c Row Posttest ; Table 2 and Figure 2 present thd results 
of the Harper & Row posttest. ^^e Words (Units 12-15) section was only 
to be administered to pupils who had completed 12 or more units; conse- 
quently, only 240 scores were received^ 

Figure 3 gives graphs by unit completed of the mean scores on 
^ach outcome pf the Harper & Row posttest. Tables 3-10 in i^ppendix C 
present the means, standard deviat;ions, *and frequency distributions for 
each outcome by the number of units l^mplg^ied. The number of units 
completed was determined individually b*) looking up the last criterion 
exercise that was received for each pupil 
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Bank Street Midterm ^ xS^e 11 and Figure 4 presei^t .the results of 
the Bank Ststeat midterm* ^ 
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Bank Street Post test ; Table 12 and Figure S present \he results 
of the Bank Street posttest. With the exception of the Word Attack and 
Structure outcomes, more than 50 percent of the pupils received scores 
in the highest two score brackets. 

Figure 6 gives graphi? by unit completed of mean scores '*bn each 
outcome of the posttest. Tables 13-19 in Appendix D present the meips, 
standard deviations, and frequency distributions for each outcome by 
the number of Units completed. 
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SOUTHWEST REGIONAL LABORATORY FOR EDUCATIONAL RESEARCH & DE\'ELOPMENT 
11300 LA QENEGA BOULEVARD • INGLEWOOD. CALIFORNIA* 90304 • TELEPHONE 776-3»o0 AREA CuDE ^3 



HARPER &ROW COVER LETTER 



\ 



Each member of the Quality Assurance sample was asked to send Criterion 
Exercises to the Laboratory, and to administer and submit mid-program 
and end-of-program performance testes*' The procedures for handling these 
data were explained during^ visit! to your schoo^. last Fall. It is now 
time to administer the mid-prograiA performance test. Enclosed are th^ 
materials you will need jfeo administer this test. 

The test contains 62 items 'and is designed to be individually administered. 
Also enclosed is an instruction sheet which gives the procedures you should 
follow in administering the test,, one test booklet, which 'is used 'to present 
the test items to each pupil, and an answer sheet for each pupil on which 
to record the pupil's responses. ' - 

The' test includes questions on seven separate outcomes qf the Harper-Row 
program; The content covers the first s.everi units of the program. Yotr 
should present all items -in the test to each pupil even though they may 
hot have received instrudtions on all seven units* at. this time. 

We ask that you administer the test between 'February 8th and 19th. You 
may test a part of your class on each day or all students on one day* 
After you have completed the testing you may w|sh to record the scores 
for your records. Then forward all completed answer sheets to SWRL in 
.the enclosed pre-addressed envelope. 

Your cooperation in providing this informati^on as well as the Criterion 
Exercises, is greatly appreciated. 




Ralph A. Hanson 

Quality Assurance Department 



RAH:om 
Enclosures 
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SOUTHWEST REGIONAL LABORATORY FVR EDUCATIONAL RESEARCH & DE\'ELOPMENT 
11300 LA CIENEGA BOLXEV^ • INGLEWOOD, CALIFORNIA 90304 • TELEPHONE 776-3800 AREA CODE iUi 

« * * 



BANK STREET COVER LETTER 



uc 



Each member of the Quality Assurance sample was asked to send Criterion 
Exercises to the Laboratory^ and to administer and submit mid-program and 
end-of-program performance tests. The procedures for handling these data - 
were explained during a visit to your school last Fall* It is now time 
to administer the mid-program performance test. Enclosed are the materials 
you will need to administer .this test. 

The test contains 50 items, and is designed to be individually administered. 
Also enclosed is an instruction sheet which gives the procedures you sliould 
follow in administering the test, one test booklet, which is used to present 
the test items to each pupil, and an answer sheet £or each pupil on which 
to record the pupil *'s responses. 

The test includes questions on seven separate outcomes 'of the Bank Street 
.prpgramV The content eovers the first five units of the program. You should 
-jTresent all items in the test to each 'pupil even though Xhey may not have 

received instructions on all five units at this time. 



We ask that you administer >the test between February 8th and 19th. You 
may test a part of your class on each day or all students on one day. 
After you have completed the testing you iftay wish to jrecord the scores for 
your records. Then forward all completed answer sheets to SWRL in the 
enclosed pre-addressed envelope. 

Your cooperation in providing this information as well as the Criterion 
Exercises, is greatly appreciated. 



Sincerely, 




*^ Ralph A. Hanson 




Quality Assurance department ♦ ^ 
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RAH:om 
Enclosures ^ 



i DIRECTIONS FOR ADMISISTERIHG THE LEARNING ^ASTERY SYSTEM 

Grade 1 Midterm Test 

« 

!• Select a testing area which is relatively quiet. ^ 

2. Record the student's name (first and last), teacher's name, school, 
* .district, and the date at the top of the answer sheet* 

3. Seat the Qhild at a table which is low enough for him to see the items 
in the test booklet. 

4. The test, is divided into 7 outcomes - 3 on the front and 4 on the 

back of the answer sheet. Begin' the test with outcome 1. 

' \ o . . • - ' 

For outcomes 1 through 3, read the Instructions at the' top of each 

' ft 
outcome for each item. For outcome 1 for example, you would read the 

instruction "Read this word." for each item in outcome 1. The same 

procedure is to be used for outcomes 2 and 3. 

6. \For outcomes 4 through 7, read the instructions as printed on the ^ 

answer sheet for each item. Each ite^ has its own separate instruction 
and should be read exactly as printied. 

7. Record the first answer made by the child b^ circling the for a 
' correct answer and tfte for an incorrect answer. If the child 

does not answer within 10 secoAds, record it as, an Incorrect answer 
by circling the and then go to the next* item. 

8. Whether or. not a student gives a correct answer, say "OK" and then 
/ go to'^ the next item. 

^' 9. Be sure to avoid giving hints either verbally or by gesture. 

10. The score for each outcome is the^ tot"frl number of correct answers, 
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HARPER & ROW MIDTERM ANSWER SHEET 
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^ SOUTHWEST REGIONAL LABORATORY FOR EDUCATIONAL RESEARCH & DE\m)PMMT 
11300 LA CIPNEGA B9(?LEVARD - INGLEWOOD,CALIFORNU 90304 • TELEPHWffi 776-3800 AREA CODE 2ja 



HARPER & ROW COVER LETTER 



The information provided throughout the school year by the teachers and 
4>upils participating in the Learning Mastery System Quality Assurance 
Program has been extremely useful in improving the program. There is one 
final item of information we ask that you provide and this is the end of 
program test. 

The test contains 69 items and is designed to be individually administered. 
Enclosed with this letter is; 1) an instruction sheet which gives the 
procedures you should follow in administering the test; 2) one test booklet 
which is used to present the test items to each pupil; 3) an answer sheet ' 
for each pupil on which to record the pupil's responses; and A) a list • 
of the pupils to be tested. ; - ^ 

The test includes questions on each of the seven separate outcomes of the 
Harper-Row Program and content from all 15 units of the program. 

We ask that you administer the test anytime before Jurve A, 1971 to a 
sample of at least 10 students. To select the students to be tested, ^ start 
at the top of the enclosed list, skipping those pupils who are no longer 
in your^ class or who are unavailable for testing. You should test at * 
least the first 10 pupils available on the list. Notice however, th^t 
enough answer sheets have been provided for all the pupils in your class. 
This allows you to test all pupils in your class, not only the ten 
requested, if time permits. , / ; 

After you have completed the testing, you may wish to rec9rd the scores 
for yoifr records. Then forward all the completed answer .sheets to SWRL 
in the enclosed pre-addressed envelope. 

Your cooperation in providing this information as well as the other Quality 
Assurance information throughout the school year is greatly appreciated. 




cerely. 




A. Han&on 
Quality Assurance Program 



om^ 
Encio 
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SOUTHWEST REGIONAL LABORATORY FOR EDUCATIONAL RESEARCH & DEVELOPMENT 
11300 LA CIENEGA BOULEV^ARD • INGLEWOOD, CALIPORNU 90304 • TELEPHONE 776-3bOO AREA CODE 213 



BANK STREET COVER I£TTER 



The information provided throughout the school year by the teachers and 
pupils participating in the Learning Mastery Syst cWQn aUty Assurance , 
Program has been extremely useful in improving the program. There is 
one final item of information we ask that you provide-^nd this is the 
end of program test, ^ 

The. test contains '63 items and is designed to be individually administered. 
Enclosed with this letter is; 1) an instruction sheet which gives the 
procedures you should follow in administering the test; 2) one test 
booklet •which is used to present the test items to each pupil; 3) an 
answer sheet for each pupil on which to record the pupil's responses; and 
4) a list of the pupils to be tested. 

The test includes questions on each of the seven separate outcomes of the 
Bank Street Program and content from all 13 units of the program. You 
should present all Items- in the test to each pupil even though they may 
not have received instruction" on all units. 

We ask that you administer the test anytime before June 4, 1971 to a 
sample of at least 10 students. To select the students to be tested, start 
at the top of the enclosed list, skipping those pupils who are no longer . 
in your class or who are unavailable for testing. You should test at least 
the first 10 pupils available on the list. Notice however, that enough 
answer sheets have been provided for all the pupils in your class. This 
allows you to test all pupils in your class, not only the ten requested, 
if time permits. 

Aft*er**you have coTiip.leted the testiing, you may wish to record the scores 
for your records. Then forward dll the completed answer sheets to SWRL in 
the enclosed pre-addressed envelope. ^ 

Your cooperation in providing this information as well as the other Quality 
Assurance information throughout the school year is greatly appreciated. 




Ralph A. Hanson * 
Quality Assurance Program 
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DIRECTIONS FOR ADMINISTERING THE LEARNING MASTERY SYSTEl^ 
Grade 1 Posttest 



1. Select a testing area which is relatively quiet. 

2. Record *the student's name (first and last), teacher's name, school, 
district, and the date af the -top of the answer sheet/1 

3. Seat the child at a table ^which is low enough for to see the items 
in the test booklet. 

4. The test is divided into 7 outcomes - 3 on the front and 4 on the 
back of the answer sheet. Begin the test with outcome 1. 



5. Fop outpomes 1 through 3, read the instructions at the top of each 

/ outcome for e^ch item. For outcome 1 for example, you would read the"* 
instruction "Read this word." for each item in outcome 1. The same 
procedure is to be used for outcomes 2 and 3. 

6. For outcomes 4 through 7, read the' instructions as printed on the 
answer ^Keet^ for each it,em. Each item has its own separate instruction 
and should be read exactly as printed. 

7. Record the first answer made by the child by circling the 'V for a 
correct answer and the for an incorrect answer. If the child 
does not answer wfthin 10 seconds, record it as an incorrect answer 
by circling the and then go to the next item. 

8. Whether or not a student gives a correct answer, say "OK" and then 
go to the next item. 

9. Be sure to avoid giving hints either verbally or by gesture. 

10. The score for each outcome is the total number of correct answers. 
Count the number of plus sighs circled and record that number in the 
box in the lover right-hand corner for each outcome. 
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APPENDIX D 

Tables 13-19 ' ^ \ ' 
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